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1. Introduction and Main Result. 

Let S{t), t G be a simple symmetric random walk on Z with initial state 
S'(O) — 0. Its upcrossings, downcrossings and (site) local time are defined for t Cz N 
and a; g Z as follows: 

U{t, := #{0 < s < i : S{s) = x, S{s-l)^x- 1}, (1.1) 
D(t, x) := #{0 < s < t : S{s) ^ x, S{s-l) = x + 1}, (1.2) 
L{t, x):^#{0<s<t: S{s) = a;} = U(t, x) + D{t, x). (1.3) 

The following identities are straightforward: 

U{t, x) - Dit, X-l) = l{0<2;<S(t)} - ^{S(t)<x<Q} (1-4) 
D{t,x) - U{t,X + 1) = Ti-{s{t)<x<0} - l{0<j;<S(t)}- (1-5) 

And from these it follows that 

L{t,x) = D{t,x) + D{t,x- 1) + t{o<x<s{t)} - ^{s(t)<x<o} 

= U{t,x) + U{t,x + 1) + l{s{t)<x<o} - Ti-{o<x <s{t)}- (1-6) 

The set oi favourite (or: most visited) sites of the random walk at time t CzN, are 
those sites where the local time attains its maximum value: 

K.{t) := {y e Z : L{t, y) ^ maxi(t, z)}. (1.7) 
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It is clear that the number of favourite sites changes in time as follows: 

r #/c(t) if s{t + )c{t + 1) 

#K:{t + 1) = I #)C{t) + 1 if IC{t + l)=JC{t)Li{S{t+l)} (1.8) 
[l if lC{t + l) = {S{t+l)} clC{t). 

In plain words one of the following three possibilities can occur at each step of the 
walk: Either the currently occupied site is not favourite and /C remains unchanged. 
Or the currently occupied site becomes a new favourite beside the favourites of the 
previous stage, and thus the number of favourites increases by one. Or, finally, a 
favourite site is visited and so this site becomes now the only new favourite. No 
other possibility. 

Clearly #/C(t) > 1 for alH > 1, and it is easy to verify that for infinitely many 
times, t > 1, there are at least two favourite sites: #/C(t) > 2. Pal Erdos and Pal 
Revesz formulated and repeatedly raised the following 

Question: Does it happen that #/C(t) > r infinitely often (i.e. almost surely for 
infinitely many times t > 1) for r = 3, 4, . . . ? 

See e.g. Erdos and Revesz (1984), (1987), (1991), Erdos (1994) or Revesz (1990) 
for an extended list of related questions and problems. 

Questions related to the asymptotic behaviour of the favourite (or most visited) 
sites of a random walk were considered by many authors since the mid-eighties. We 
quote here a few relevant results, with no claim of exhaustiveness. 

• Bass and Griffin (1985) prove that almost surely, the set of favourites is transient. 
More exactly: they prove that the distance of the set of favourite sites from the 
origin increases faster than ^/ri/ {logn)^^ but slower than y^/(logn). 

• Csaki and Shi (1998) prove that the distance between the edge of the range of 
the random walk and the set of favourite sites increases as fast as ^/n/ (loglogn)^/^ 

• Csaki, Revesz and Shi (2000) prove that the position of a favourite site can have 
as large jumps as ^2nlog logn, i.e., comparable with the diameter of the full range 
of the random walk. They also extend a much earlier result of Kesten (1965), iden- 
tifying the set of joint limit points of the set of favourite sites and the favourite 
values (i.e. max. values of local time), both rescaled by -v/Snloglogn 

• There are many papers dealing with similar qestions in the context of symmet- 
ric stable processes rather than random walks (or Brownian motion). See, e.g., 
Eisenbaum (1997), Bass, Eisenbaum and Shi (2000) and other papers quoted there. 

In the present paper we answer in the negative the question of Erdos and 
Revesz quoted above, for r > 4: we prove that with probability 1, there are at 
most finitely many times t > 1 when there are four or more favourite sites of 
the random walk S{t). In Toth and Werner (1997) a similar result was proved 
for the set of favourite edges rather than favourite sites. The present paper deals 
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with the original question of Erdos and Revesz. The starting general ideas of the 

present paper (see Sections 1-3) are very close to those of Toth and Werner (1997). 
However: the details of the proof require more refined estimates and arguments. 
On the technical level (see Sections 4-6) this proof is rather different. 

For r > 1 denote by /(r) the (possibly infinite) number of steps, when the 
currently occupied site is one of the r actual favourites: 

f{r) ■■= #{t > 1 : [Sit] e JC{t)] A [#/C(t) = r]}. (1.9) 

From (1.8) it follows that for any r > 1, /(r 4- 1) < /(r). (Both sides of the 
inequality could be infinite.) 

The main result of this paper is the following 

Theorem 1. 

E(/(4)) < 00. (1.10) 

Remarks: (1) From this theorem the negative answer to the question of Erdos and 
Revesz clearly follows, for the cases r > 4. 

(2) The case r = 3 remains open. Prom the proof of the above theorem it becomes 
clear that E^/(3)^ = oo. Nevertheless we conjecture that /(3) < oo, almost surely. 

The paper is organized as follows: In Section 2 we perform some straightfor- 
ward manipulations (essentially: rearrangements of sums). In Section 3 we recall 
the Ray-Knight Theorems for the local times of simple random walks. In Section 4 
first we express our relevant probabilities and expectations (found in Section 2) in 
terms of the Galton- Watson processes arising with the Ray-Knight representation. 
Then we formulate Proposition 1, stating some upper bounds on these probabili- 
ties and expectations, and using these bounds we prove Theorem 1. The proof of 
Proposition 1 is postponed to the end of Section 5. In Section 5 four lemmas and, 
as their consequence. Proposition 1 are proved. Throughout the technical parts 
of the proofs smaller, quite plausible statements are invoked. These are called 
Side- lemmas (1 to 7). Their proofs are postponed to Section 6. 

Throughout the paper, in various upper bounds, multiplicative constants, re- 
spectively, constants in exponential rates will be denoted generically by C, respec- 
tively, by 7. The values of these constants may vary even within one proof, but we 
hope there is no danger of confusion. 

2. Preparations. 

In the following transformations the inverse local times, defined below for fc e N 
and a; e Z, will play an essential role: 



Tuik,x) := mi{t > 1 : U{t,x) = k}, 
TD{k,x) := inf{i > 1 : D{t,x) = k}. 



(2.1) 
(2.2) 
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It turns out that questions related to the local time are easier to handle if the 

random walk is observed at the random stopping times T[/(fc, x) and To{k, x) rather 
than at deterministic times t>l. This 'combinatorial trick' has its origin in Knight 
(1963) and has been successfully applied in various contexts. See, e.g., Konig (1996), 
Toth (1995), (1996) and references cited there. 

We express /(4) with the help of some straightforward rearrangements of sum- 
mations: 

f{A) = Y.{<^)+d{x)) (2.3) 



where 



x62 



oo 



{S{t)=x, S{t-l)=x-l, xelCit), #K{t)=i} 

t=l 

oo oo 

t=i fe=i 

CO 

-^^{xeK{Tu(k,x)), H^K{Tu(k,x))=i} 

k=l 



(2.4) 



and 



:=^lis{t)=x, S{t-i)=x+i, xeiC(t), #K{t)=i} 



Clearly, 

and, consequently 



CO CO 



ik,x)=t, x(^K{t), #K{t)=A} 



t=l fc=l 

oo 



E 



= E ^{^e'C(TD(fe,x)), #K:(TD(fe,x))=4}- 
fe=l 



u{x) ^= d{—x) 



oo oo 

(/(4)) = 2^e(^x)) +2^E(d(a;)) 



x=l 



x=0 



with 



E 



E 



(2.5) 



(2.6) 



(2.7) 



OO 

(u{x)) =J2^([x e IC{Tu{k,x))] A [#IC{Tu{k,x))=4]) (2.8) 
fc=i 

oo 

(d(a;)) =^p([xe/C(Tc(fc,a;))] A [#/C(r^(fc, a;)) = 4]) (2.9) 



fe=i 
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We shall show in details that 
Y,E(u{x))=^^p([x&IC{Tu{k,x))] A [il^lC{Tu{k,x))=4]) <oo. (2.10) 



x=l x=l k=l 

The similar statement 



oo oo 



^E(d(x)) =^^p([xe/C(TB(fc,a;))] A [#/C(r^(fc, x)) = 4]) < oo (2.11) 

x=0 x=0 fe=l 

can be proved in an identical way. 
3. Ray-Knight Representation. 

Throughout this paper we denote by a critical branching process with geometric 
offspring distribution (Galton- Watson process) and by Zt a critical branching pro- 
cess with geometric offspring distribution and one intruder at each generation. Yt 
and Zt are Markov chains with state space Z+ and transition probabilities: 



p(Yt+i=j\Yt = i)=n{i,j) 



Sqj if i = 0, 



p(^Zt+,=j\Zt =i)= p{i,j) := 2-'-^-i^^±^. (3.2) 



Let fc > and a; > 1 be fixed integers and define the following three processes: 

• .^t, < t < a; — 1, is a Markov chain with transition probabilities p{i,j) and 
initial state Zq = k; 

• Yt,— l<f<oo, isa Markov chain with transition probabilities n{i,j) and 

initial state Y^i = k; 

• Finally, Y"/, < i < oo, is another Markov chain with the same transition 
probabilities TT{i,j) and initial state Yq — Z^-i- 

The three chains are independent, except for the fact that Y' starts from the ter- 
minal state of Z. Using these three chains we patch together the process 

r Z^_y_i if 0<y<x-l 

^x,k{y) ■■= I Yy-x if a;-l<y<oo (3.3) 
\ Y!_y if -OO < y < 0. 

We also define 

^x,k{y) '■= ^x,k{y) + ^x,k{y - 1) + '^{o<y<x}- (3.4) 
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According to the, by now classical, Ray-Knight Theorems on the local time process 
of simple symmetric random walks on Z (cf. Knight (1963), Ray (1963)), for any 
integers x > 1 and A; > 0: 



(A,,fc(y), y€Zy^ (^D{Tu{k + l,x),y), ysz). 
Using (1.6) and (3.4), from this we get 

{Kk{y), y€Zy^ (^L{Tu{k + l,x),y), yez). 



4. Proof of Theorem 1. 

Given the Markov chains Yt, Zt and y/ we define 

Zt := Zt + Zt_i + 1, Yt:=Yt + Yt_i, 
and for /i e N the following stopping times 



For h> 1, p>0 and x >1 fixed integers we define the following events: 
max {Ft : 1 < i < oo} < /i| 



A 



-h,0 



A' 

h,p 



(3.5) 



(3.6) 



r/:=r/ + r/_i (4.i) 





:= mf{t > : 


Yt > h}, 








(4.2) 




:= inf{t > : 


Yl > h}, 








(4.3) 


UJ 


:= inf{t > : 


Yt = 0}, 








(4.4) 


J 


:= inf{t > : 


y: = 0}, 








(4.5) 


Th 


:= inf{t > : 


Zt > h}, 








(4.6) 


<^h,0 


■~ 0, (Th.i+l 


:= inf{t > ah,i 


: Yt > h}, 




'■= ^h,l, 


(4.7) 




■= 0, ^'h,i+i 


~ mi{t > a'f^^ 


: Y; > h}, 


~i 




(4.8) 


Th,0 


:= 0, Th,i+i 


:= mi{t > Th,i ■ 


Zt > h}, 






(4.9) 



■p]} 



[max{Yt : 1 < f < 00} = /i] A [#{1 < t < oo -.Yt = h} = 
\ah,p < oo = ah,p+i] A [F?^ , = h, i = 1, . . . , 
max{F/ : 1 < i < oo} < /i| 

^'h = oo } . 

[max{F; ■.l<t<oo] = h] A [#{1 <t<oo:Yt=h}=p\^ 



(4.10) 
(4.11) 
(4.12) 
(4.13) 
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Bx,h,o ■= |max{Zt :l<t<x}<hj 

= { Th>x }, (4.14) 
Bx,h,p := {[inax{Zt :l<t<x} = h] A [#{1 < t < x : Zt = h} = p]^ 

= [[rh,p <x< Th,p+i] A [^^.^ , =h, i = 1, . . . . (4.15) 

With the help of the Ray-Knight representation and the events introduced above 
we get the expression: 



oc oc oc 



P+g+r=3 h=l fc=0 1=0 

n{k, h - k- l)x 

p(A',,,|ro' = /) 

which leads directly to 

^e(«(x))< Y1 EE P{Ah,p\Yo = h-k-l)x 

Tr{k,h- k-l)x 

' oo \ 
J2P{Bx,h,g\Zo = k) X 



(4.16) 



x=l 



p+q+r=3 h=l fe=0 



l>0 ^ 



(4.17) 



The proof of Theorem 1 will follow directly from the bounds provided by 

Proposition 1. For any £ > there exists a finite constant C < oo such that for 

any h > I and k > 0: 
(i) Without any restriction on k or p 



oo 

Y^v(Bx,h,p\Zo = k)<Ch 



(4.18) 



(ii) if either kG[{h- h^/^+^)/2, {h - h^/^+^)/2] orp>l holds then 

,p+i 



'[Ah,p\Yo=k) <(ch-^/^+'y 

J2p{Bcc,h,p\Zo = A;) < (ch-^/^+'Y^^ h 



(4.19) 
(4.20) 



Remark: For k> h the left hand side of (4.18), (4.19) and (4.20), of course, vanish. 
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We postpone the proof of this Proposition to the end of the next section and 
proceed with the proof of Theorem 1. Using the bounds (4.18)-(4.20) wc prove 
(2.10). As we ahcady mentioned, (2.11) is proved in a completely identical way. 
Theorem 1 follows from (2.10), (2.11) via (2.7). 

In the forthcoming argument • • • will stand as abreviation of the summand on 
the right hand side of (4.17). On the right hand side of (4.17) keep p,q,r and h 
fixed and decompose the sum over fc > as follows: 

= + E--- (4-21) 

k fc:|/i-2/s|</ii/2+E fc:|/i-2fc|>fti/2+= 

Similar decompositions will be applied a few more times throughout the paper. 

Side- lemma 1. For any e > there exist constants C < oo and 7 > such that 
for any h>l 

E 7r()fe,/i - 1 - fc) < Cexp(-7/i2^). (4.22) 

fe:|/l-2fc|>fti/2+E 

Side-lemmas arc proved in Section 6. 

Using (4.18)-(4.21) we bound the sum over k on the right hand side of (4.17) 
as follows: 

If r = and p + q = 3 

E • • • < (ch-^/^+'Y^'^^ h + (Ch) (Cexp(-7/i2^)) 

k 

< C"/i-3/2+5^ (4.23) 

with some properly chosen C' < 00. 
If r > and p + q + r = 3 

E • • • < (ch-^/^+'Y^"^'^^^ h + {Ch) (Cexp(-7/i2^)) 

k 

< C"/i-2+6^ (4.24) 

with some properly chosen C < 00. 

In both cases the upper bound is summable over h> 1, if we choose e < 1/10. 
Hence (2.10) and the statement of Theorem 1. 
□(Theorem 1) 

5. Technical Lemmas. 

The present section is divided in five subsections. In subsections 5.1-5.4 we state 
and prove some lemmas of more technical nature, needed in the proof of Proposition 
1, which is presented in subsection 5.5. Throughout this section £ > is fixed. 
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5.1. The Maximal Jump. 

We prove that the largest jump of the Markov chains and Zt, before reaching 
level h, is less than with overwhelming probability. Define the maximal 

jumps of It, respectively, Zt as follows: 



Mh :=sup{|yt - Yt-i\ ■.l<t<ah} 

= sup{|yt-yt_i| ■.l<t<ahAu)}, 
Nh -supilZt-Zt-i] :l<t<Th}. 

By definition Mh ^ ii Yq > h a.nd Nh = if Zq > h. 



(5.1) 
(5.2) 



Lemma 1. There exist two constants, C < oo and 7 > 0, such that for any h> 1 
and k > the following bounds hold: 



P 
P 



(m^ > h^/^+'lVo = kj < Cexp(-7/i2^), 
(^Nh > = fc) < Cexp(-7/i2^). 



(5.3) 
(5.4) 



Proof. We prove here (5.3) in details. The proof of (5.4) is essentially similar and 
it is left for the reader. For the moment let 7 be an arbitrary positive number. Its 
value will be fixed at the end of this proof. 

p(Mft>/ii/2+e Yo = k^ 

< p([Mh > h^'^+'] A K A < /i^ cxp(7/i2")] Fo = 

+P(crft A w > /i^ exp(7/i2^) Yo = fc) (5.5) 

Side-lemma 2. There exists a constant C < 00, such that for any h > 1 and 
k>0 

F,(ah A ojYo = k^ <Ch'^. (5.6) 

By using Markov's inequality we get the following upper bound on the second term 
of the right hand side of (5.5): 

P(^ah Aoj> /i^exp(7/i^^) = fc) < C exp{--fh'^'). (5.7) 

To bound the first term on the right hand side of (5.5) wo use the following repre- 
sentation of the Markov chain Yt: Let (Ct,i)(>i i>i be i.i.d random variables with 
common geometric distribution P^^t,i = k^ = 2~''~^ The process Yt is realized as 
follows: fix lo and put 



Yt 



(5.8) 
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Using this representation we note that 

p([Mh > h^^^+'] A [ah A CO < h^exp{jh^')] Yq = /c) 



< P I max < max 

V i<j<h 



= 1 — I 1 — P ( max 

V l<j<h 



i=l 



> h^/^+'] 1 (5.9) 



Side-lemma 3. Let be i.i.d. random variables with the common geometric dis- 
atribution p(^Ci = = 2~'^~^. Then there is a constant 9o > such that for any 
A > and n gN satisfying A/(4n) < ^o-' 



P( max 

\ l<j<n 



> a) < 2exp(-AV(8n)). (5.10) 



Using this bound we get 

p([Mh > A [ah AwKh^ exp(7/i2^)] Yq = fc) 

<l-(l-2exp(-/i278))''^^^^^''"^ 



< 2/i2exp((7-8"i)/i2^y 



(5.11) 



In the last inequality wc use the fact that for < a < 1 < \ — a(i < (1 — a)^. We 
choose 7 < 16^^. From (5.5), (5.7) and (5.11) we get (5.3), with an appropriately 
chosen constant C < oo. 
□ (Lemma 1) 

5.2. Hitting exactly h. 

Lemma 2. There exists a constant C < oo such that for any h>l and k>0 



P(jah < oo] A [Y^^ =h]\Yo = k^ < Ch-^'^+' 



(5.12) 
(5.13) 



Proof. Again, we give the details of the proof of (5.12), leaving the identical details 
of (5.13) for the reader. 



P(ph<oo] A [Y^^ = h]\Yo = k) = 

OO 

J2P{[^h<^] A [Y2 



I] A [Y^,=h-l] 



Ya = k] 



(5.14) 
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We divide the sum in two parts, as in (4.21): 

J2 ^{[^h < oo] A =1] A [Y^, =h-l]\Yo = 

l:\h-2l\>h^/^+^ 



<P 



(m^ > h^/^+'lVo = fc) < Cexp(-7/i2^), 



(5.15) 



by Lemma 1. On the other hand: 

^ P([ah < 00] A =1] A [Y^, =h-l]\Yo = k) = 

tt{1, h - I) 



^ p([a^<oo] A [Y~,,-i=l] 

i:|/t-2i|</ii/2+£ 



Yn^k 



Side-lemma 4. There exists a constant C < oo, such that for any h > 1 
lG[{h- /iV2+^)/2, {h + /lV2+e)/2] 



■K{l,h-l) 



< Ch-^'^+' 



(5.17) 



From this wc get 



^ V([ah < oo] A [y^,.! =l]A [y^, = h-l]\YQ = k)< C/i-V2+^ (5.I8) 

Finally, (5.15) and (5.18) yield (5.13). 
□(Lemma 2) 

5.3. Yf does not hit level > h. 

Lemma 3. There exists a constant C < 00 such that for any h > 1 and k G 
[(/i-/iV2+e)/2,(/i + /iV2+e)/2] 



(ah = ooYo = k^ < Ch-^/^+'. 



(5.19) 



Proof. 



I>(ah = oo|yo = fc) < P(jah = 00] A [Mh < h^/^+']\Yo = A;) 

+ P (Mfc > /iV2+e = fc) . (5.20) 

To bound the first term on the right hand side, note that 

{[ah = 00] A [Mh < /iV2+-]} c { a^h+h^;.+sy^ = 00 } . (5.21) 
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Side-lemma 5. There exists a constant C < oo such that for any < k < h 

h-k 



P CTft = oo 



Yo=k 



(5.22) 



Thus 



Yo = k 



(5.23) 



for k e [(/i-/iV2+£)/2, (/i + /iV2+£)/2]. This bound, together with (5.20) and (5.3) 
yield (5.19). 
□(Lemma 3) 

5.4. Expectation ofrh- 

Lemma 4. There exists a constant C < oo such that for any h > 1 the following 
bounds hold: 

(i) Without any restriction on k: 



-E(Th Zo = k^ < Ch. 
(ii) For ke[{h- /iV2+e)/2, (/i + /ii/2+e)/2] 

E(Th Zo = k^ < Ch^/^+'. 



(5.24) 



(5.25) 



Proof. 

E^T/i Zo = k^ = E^T>il{;v^</(i/2+s} 



Zo = k^ + E(Tfcl{;v;.>fci/2+e} Zo = ky 

(5.26) 

We bound the first, respectively, the second term on the right hand side, by noting 



respectively. 



'^/il{iVfc</ii/2+=} < T(^+?ji/2+£)/2, 



Th < Th. 



(5.27) 

(5.28) 



Thus we get 

E^T/i Zo = k^ < E^r(,,_,_,,i/2+e)/2 



E 



(Ti\zo=ky'^p(^Nh>h' 



Zo 

1/2 



/2+e 



Zo = k 



1/2 



(5.29) 
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Side-lemma 6. There exists a constant C < oo such that for any < k < h 

Eivh Zo = k^ <{h-k)+ Ch^/^. (5.30) 

Side-lemma 7. There exists a constant C < oo such that for any < k < h 

e(t^ Zo = fc) <C/i^ (5.31) 

Putting together (5.29), (5.30) and (5.31), we get (5.24) and (5.25). 
□ (Lemma 4) 

5.5 Proof of Proposition 1. 
First note that 



OO oo 

J2'P{B^,h,o\Zo = k^ =^p(?>,>a;|Zo = A;) =E(Tfc|Zo = A;), 



(5.32) 



(5.33) 



and for p > 1, using the strong Markov property of Yt, respectively, Zt : 

oo 

p(^Ah,p\Yo = k)=Y,P{{^h<oo] A [Y^,-i = h-l] A [Y^^=l]\Yo = k)x 

1=0 

p(A,p_i|yo = ^) (5-34) 

OO oo 

Y^p(^B,,h,p\Zo = k)= J2^([Zr,-i = h-l] A [Z^, = l]\Zo = fc)x 

x=l 1=0 

(fy(B,,h,P-i\Zo = l)^ ■ (5.35) 

We prove the bounds of Proposition 1 by induction on p. 

According to (5.32), (5.33), for p = 0, (4.18), (4.19) and (4.20) are just re- 
statements of (5.24), (5.19) and (5.25), respectively. (See Lemma 3 and Lemma 
4.) 

Next we consider the case p = 1. Again, wc divide the sum over I in (5.34) and 
(5.35) in two parts, as it was done in (4.21). From (5.12) (Lemma 2) and (5.19) 
(Lemma 3) 

J2 P{[^h < oo] A [y^,_i = h-l] A [Y^, = 1]\Yo = k)v[Ah,o\Yo = l) 

;:|ft-2i|</ll/2+e 



< 



(5.36) 
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Prom (5.3) (Lemma 1) 

J2 P(p/»<oo] A [Y^^_,^h-l] A [Y;^^=l]\Yo = ky(^Ah,o\Yo=l) 

i:|/t-2i|>/ii/2+s 

< p(Mfe > /i^^+e Yo = k^ < Cexp(-7/i2^) (5.37) 

From (5.36) and (5.37) wc get (4.19) for p=l. 

Applying the same ideas to (5.35): from (5.13) (Lemma 2) and (5.25) (Lemma 

4) 

OO 

P{[Zr,-i = h-l] A [Z^,=l]\Zo = k)Y,p(^B,,h,o\Zo = l) 

< (cft-i/2+^) (5.38) 
Prom (5.4) (Lemma 1) and (5.24) (Lemma 4) 

CxD 

^ p{[Z~,,_i = h-l] A [Z^,=l]\Zo = k)j2p(^B,,h,o\Zo = l) 

(:|/l-2(|>/ii/2+e x=l 



<p[Nh> h^/^+'\Zo = k) |^sup^^p(b,,m|^o = /) j 

< (Cexp(-7/i2")) [Ch) (5.39) 



(5.38) and (5.39) yield (4.20) for p = I. 

For p > 2 the induction follows from the same reasonings, just one does not 
have to split the sum over I as in (5.36), (5.37). After the previous arguments we 
may ignore these completely straightforward details. 
□(Proposition 1) 

6. Proof of the Side-Lemmas. 

First we prove Side-lemmas 1 and 4. Then Side-lemma 3 follows, which relies on an 
exponential Kolmogorov inequality. These proofs are rather standard 'classroom 
exercises'. Side-lemmas 2, 5, 6 and 7 follow from an estimate on the overshooting 
of level h by the processes Yj and Zt stopped at ah Au), respectively, Th and from 
optional stopping arguments. 

Proof of Side-lemma 1. 

Assume h > 2 and denote h — 2 =: n, k — 1 =: I. Then, using the explicit form 
(3.1) of 'jT{i,j), the right hand side of (4.22) becomes 

^ 7r(A;,/i-l-fc) = ip(|2B„-n| > (n + 2)i/2+^) (6.1) 

fe:|/(-2fe|>/ll/2+e 



NO MORE THAN THREE FAVOURITE SITES FOR SIMPLE RANDOM WALK 15 



where B„ is binomially distributed: P (-B„ = Z) = (")2 Using the fact that for 
any 7 < 1/2 

sup E exp I7 (2B„ - nf /n^^ = < 00, (6.2) 

by Markov's inequality we get (4.22). 
□ (Side- lemma 1) 

Proof of Side-lemma 4- 

Note first that for i > 1 and j > 



TriiJ) 2(1 +i) 



(6.3) 



From this it follows that the distribution j t-^ 7r(i, j) is unimodular and for i > 2 
fixed 

T^{i,j) < T^ihj + '^), for0<j<i-3, 

7r(i,i-2) = 7r(i,i- 1), (6.4) 

n{i,j) > n{i,j + 1) for i — 1 < j < c». 

We treat separately the cases I G [h/2, {h + h'^^'^+'')/2] and I e [{h-h^/'^+^)/2,h/2]: 
For I e [h/2, {h + /ii/2+e)/2] the following two facts imply (5.17) 
(1) By (6.4), 



Ti(l,h-l) < tt{IJ-1) = 



l|^2(Z-l)^2-2G-i) 



2 \ L"-/2J 1 / 

(2) By the central limit theorem: limj_»oo X^m>; ""(^j ™) = 5 and thus there exists 
a constant c > such that for any < h/2 < I 

^ Tr{l,m)>^Tr{l,m)>c (6.6) 

m>h—l m>l 

Let now l€[{h + h^/'^-^)/2, h/2] and k:=[h-l + /iV2-ej Then: 
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k-h+l 



2{h-i + h'/^-^y 

/l+/ll/2-£ _ 1 
/l + /lV2-e-l 



</l-l/2+. (l+3/l-(V2-c)^ 

< e=^/i-V2+- (6.7) 

In the first inequality we used (6.1). In the second one we exploited the fact 

that, according to (6.2), for any i > 1 fixed Tr{i,j)/TT{i,j + 1) is an increasing 
function of j > 0. In the next equaUty, (6.2) was explicitly used. In the third 
inequality we inserted the value of A: = [h — I + /i^/^^^J . In the fourth inequality 
I = \{h — /i^/^~^)/2] was inserted to maximize the expression. In the last but one 
inequality we used 1 < h}/'^~^ < Finally, in the last inequality we use the 

fact that sup„>i (l + 3q!~^)" < 

□ (Side-lemma 4) 

Proof of Side-lemma 3. 

The Exponential Kolmogorov Inequality follows directly from Doob's maximal in- 
equality. For its proof see e.g. page 139 of Williams (1991). 

Exponential Kolmogorov Inequality. Let^j, j > 1, be i.i.d. random variables 
with E^exp |^ ?i } ) < oo for some 9 > and ^(^ij = 0- Then for any X S 
(0, oo) and n e N 

P( t^^ > a) <e--{E(e^^f + E(e-^~f } (6.8) 

i—l 

We apply the Exponential Kolmogorov Inequality to = — 1, with P^^i = kj = 
2"*^"^, fc > 0. There exists a constant > such that for < ^ < we get: 

E(e^(«-i)) = e-» = l + 9^+0 (9^) < e^^' (6.9) 

E(e-^(«'-i)) = e^' {2e' - ly' = I + 9' + O {9^) < e^'" (6.10) 

Inserting these bounds into the right hand side of (6.8) and choosing 9 = A/(4n) 
we obtain (5.10). 

□ (Side- lemma 3) 

The proof of Side-lemmas 2, 5, 6 and 7 will follow from the forthcoming Over- 
shooting Lemma and standard optional stopping considerations. The Overshooting 
Lemma and its Corollary are extended restatements of Lemmas 3.2 and 3.4 from 
Toth and Werner (1997). 
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Overshooting Lemma. For any < k < h < u the following overshoot bounds 
hold: 



P i;. >u 



[Yo = k]A [ah < oo]) < P(ri > u\ [Yo = h] A [Fi > /i]) 
Zo = k^ < p(^Zi >u[Zo = h] A [Zi > h]^ 



(6.11) 



(6.12) 



In particular it follows that 
Corollary. There exists a constant C < oo such that for any < k < h: 

E(y<,, [Yo =k]A [a, < 00]) < gS^^^f,'''^!; < h + Ch'/' 

E(y,2^ I [Y, ^k\A [a, < oo]) < <h^+ Ch"' 

Zo^k)<^^f%^<h + Ch^/^ 
^ ^ E^=/i pC^, w;) 

(zlZo = k)<^f^<h^ + Ch^/^ 



E z. 



E 



(6.13) 

(6.14) 

(6.15) 

(6.16) 



The rightmost bounds in (6.13)-(6.16) follow from explicit computations. 
Proof of the Overshooting Lemma. 

Straightforward manipulations leed to the following identities for 1 < h < v: 
P(ya, = v\[Yo = k] A [ah < oo]) = 

J2 P (y<^.-i = l\[Yo = k]A [an < oo]) J^^'^i 



P Z. 



h-l 



1=0 



'Th-1 



p{l,v) 



(6.18) 



Using the explicit form (3.1), respectively, (3.2) of the transition probabilities 
7r(i,j), respectively, p{i,j), it is easy to check the following inequalities, which 
hold for any < I < h < v, respectively, < I < h < v: 



tt{1 + 1,v) _l + v ^ l + v + 1 _ t:{1 + l,v + 1) 



■k{1,v) 



21 



21 



tt{1,v+1) 



p{l + l,v) _ ; + ^; + l l + v + 2 _ p{l + l,v + l) 
p{l,v) ~ 2{l + l) ^ 2{l + l) ~ p{l,v + l) 



(6.19) 
(6.20) 
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It follows that for any 0<l<h<v<w 



77(1 + 1, v)tt{1, w) < Tr{l, v)'!r{l + 1, w), 
p{l + 1, v)p{l, w) < p{l, v)p{l + 1, w). 

Hence, for any < I < h < u 

00 00 00 00 

J2 + 1' ^) ^)<J2 J2 A^ + 1' 

v—h w—u v—h w—u 

00 00 00 00 



(6.21) 
(6.22) 



(6.23) 
(6.24) 



v=h 



which directly imply (6.11), respectively, (6.12). 

□ (Overshooting Lemma) 

Proof of Side-lemmas 2 and 5. 

We apply the Optional Stopping Theorem to the martingales Yj (for Side-lemma 
5), respectively, — 2 X]l=o (for Side-lemma 2), t > 0, both stopped at a^, A oj. 
First we prove Side-lemma 5: 

k = e(y^^^^\Yo = fc) = E(y^,|[yo = k] A [at < oo])p(ct^ < oo|yo = fc) 

<(h + CVh^ p(ah<ooYo = ky (6.25) 

Where, in the last inequality we applied (6.13). Hence (5.23). 

□ (Side- lemma 5) 

Next we prove Side- lemma 2: 



k' = -E{YX^^-2 J2 Ys\Yo = k)<E(YX^^\Yo = k)-2E(ah 



s=0 



A uj 



Yo = k), 
(6.26) 



where in the last inequality we used the fact that > 1 for s < w. Hence 

2E(ahAa; Yq = k^ < e(y^^ [Yq = k] A [ah < oo])p(ah < 00 = fc) -fc^ < Ch"^. 

(6.27) 

In the last inequality we used (6.14). 
□(Side-lemma 2) 

Proof of Side-lemmas 6 and 7. 

We apply the Optional Stopping Theorem to the martingale Zt — t (for Side- lemma 
6), respectively, to the supermartingale — 2tZt (for Side-lemma 7), t > 0, both 
stopped at r/j. 
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First Side- lemma 6: 

-E(Th Zo = kj = ^{Zr^ Zo = k^-k<h-k + CVh. 

In the last inequality (6.15) was used. 

□ (Side-lemma 6) 

Next, Side- lemma 7: 



(6.28) 



E 



(tI\Zo = fc) < 2I^(ThZr,\Zo = A;) < 2^ 



h E 



Hence, using (6.16) we get 



E(r2|Zo = A;) < 4e(^Z^ 



k] < Ch\ 



Zo = kj 

(6.29) 

(6.30) 



□(Side-lemma 7) 
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